Speech Interaction Can Support Problem Solving

Speech can lead to increased performance in computer-based problem solving. Studies of complex interaction styles — such as command-line or system-delayed interaction — have found that complex interaction styles can lead to savings in the number of actions users take to reach a solution for certain tasks compared with direct manipulation. Speech can be viewed a complex interaction style because it requires users to reference objects symbolically, rather than through deictic reference, and often involves a system delay. We compared speech interaction with two previously studied interaction styles — delayed interaction and direct manipulation — on the 8-puzzle task. The results show that speech leads to significant savings in moves to solution. Importantly, these savings are not at the expense of greater overall solution times. Savings through speech can be primarily attributed to the effects of system delay. These results suggest the potential for speech interfaces to be used as a tool support problem solving.